Analyzing the Resilience of Convolutional Neural Networks Implemented on GPUs
نویسندگان
چکیده
There have been an extensive use of Convolutional Neural Networks (CNNs) in healthcare applications. Presently, GPUs are the most prominent and dominated DNN accelerators to increase execution speed CNN algorithms improve their performance as well Latency. However, prone soft errors. These errors can impact behaviors GPU dramatically. Thus, generated fault may corrupt data values or logic operations cause errors, such Silent Data Corruption. unfortunately, propagate from physical level (microarchitecture) application (CNN model). This paper analyzes reliability AlexNet model based on two metrics: (1) critical kernel vulnerability (CKV) used identify malfunction light- each kernel, (2) layer (CLV) track light-malfunction through layers. To achieve this, we injected which was popularly applications NVIDIA’s GPU, using SASSIFI injector major evaluator tool. The experiments demonstrate average error percentage that caused models has reduced 3.7% 0.383% by hardening only vulnerable part with overhead 0.2923%. is a high improvement for
منابع مشابه
Escort: Efficient Sparse Convolutional Neural Networks on GPUs
Deep neural networks have achieved remarkable accuracy in many artificial intelligence applications, e.g. computer vision, at the cost of a large number of parameters and high computational complexity. Weight pruning can compress DNN models by removing redundant parameters in the networks, but it brings sparsity in the weight matrix, and therefore makes the computation inefficient on GPUs. Alth...
متن کاملAnalyzing Stability of Convolutional Neural Networks in the Frequency Domain
Understanding the internal process of ConvNets is commonly done using visualization techniques. However, these techniques do not usually provide a tool for estimating the stability of a ConvNet against noise. In this paper, we show how to analyze a ConvNet in the frequency domain using a 4-dimensional visualization technique. Using the frequency domain analysis, we show the reason that a ConvNe...
متن کاملEvolving Neural Networks on GPUs
Financial Time Series prediction attempts to model the behavior of financial markets using, among other things, tools like technical, intermarket, and fundamental indicators. Accurate prediction, however, is difficult for a number of reasons: financial markets are influenced, often in a non-linear, sometimes time-lagged fashion, by factors including interest and exchange rates, the rate of econ...
متن کاملNotes on Convolutional Neural Networks
We discuss the derivation and implementation of convolutional neural networks, followed by an extension which allows one to learn sparse combinations of feature maps. The derivation we present is specific to two-dimensional data and convolutions, but can be extended without much additional effort to an arbitrary number of dimensions. Throughout the discussion, we emphasize efficiency of the imp...
متن کاملNeural Networks on GPUs: Restricted Boltzmann Machines
Despite the popularity and success of neural networks in research, the number of resulting commercial or industrial applications have been limited. A primary cause of this lack of adoption is due to the fact that neural networks are usually implemented as software running on general-purpose processors. In this paper, we investigate how GPUs can be used to take advantage of the inherent parallel...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International journal of electrical and computer engineering systems
سال: 2021
ISSN: ['1847-6996', '1847-7003']
DOI: https://doi.org/10.32985/ijeces.12.2.4